About

Harsh Vardhan Singh is a highly skilled Data Engineer with over 4 years of experience in the field of cloud engineering and big data. He has a strong proficiency in various tools such as Azure, AWS, Databricks, Snowflake, Spark, Power BI, Airflow, HDFS, and Hadoop, and has a vast knowledge of both Python and SQL. Harsh's responsibilities include designing and developing big data solutions using agile methodology, as well as interpreting and analyzing data to drive successful business outcomes. He has worked on Big Data projects in various domains such as Retail/Pharma, Pharma, and E-commerce, including Walgreens, Novartis, and Amazon. Harsh has a vast knowledge of various technologies and languages, including Python, Spark, pySpark, SQL, Hadoop/MapReduce/HDFS, Hive, Amazon S3, Redshift, Step function, Lambda, CloudFormation, AppFlow & API Gateway, Azure Data Factory, Synapse, and Cosmos DB. He is also proficient in various tools such as Databricks, Airflow, Talend, GIT, CDK Deployment, JIRA, Snowflake, and PowerBI. Currently, Harsh is working as a Data Engineer at Amazon, where he is part of the Amazon Prime Team. He has developed a data analytics pipeline for PMs to get insights into Prime Customer's Acquisition, Retention, and Engagement, using technologies such as Python, SQL, API Gateway, Step function, DynamoDB, Lambda function, Glue ETL, and Quicksight. He has also created statistical analysis of data for metrics evaluation using Z-test, Kolmogorov test, and Mann-Whitney U test. Harsh has previously worked as a Data Engineer I at Accenture and as a Big Data Engineer at TCS. At Accenture, he built an end-to-end data pipeline using Python, PySpark, and SQL language, which processed 100GBs of History and Incremental SharePoint data using Axway API and Databricks to S3 bucket using AWS Lambda function triggered using AWS API Gateway. At TCS, he optimized and rebuilt obsolete code and processes to acquire meaningful data using Python, Scala, Spark-SQL, HIVE, SQOOP, HADOOP for analysis and forecasting. Harsh holds a Bachelor of Technology in Computer Software Engineering from Dr. A.P.J. Abdul Kalam Technical University, Ghaziabad. He